(19) 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(43) Date of publication: 

03.12.1997 Bulletin 1997/49 



(11) EP 0 810 512 A1 

EUROPEAN PATENT APPLICATION 

(51) Intel 6: G06F 1/32, G06F 3/00 



(21) Application number: 97303620.5 

(22) Date of filing: 28.05.1 997 



(84) Designated Contracting States: 


• Glass, Bob 


DE FR GB NL SE 


Los Gatos, CA 95030 (US) 


(30) Priority: 30.05.1996 US 655134 


• Toganazzini, Bruce 


Woodside, CA 94062 (US) 


(71) Applicant: SUN MICROSYSTEMS, INC. 


(74) Representative: Read, Matthew Charles et al 


Mountain View, California 94043-1100 (US) 


Venner Shipley & Co. 




20 Little Britain 


(72) Inventors: 


London EC1 A 7DH (GB) 


• Nielsen, Jakon 


Atherton, CA 94027 (US) 





(54) Eyetrack-driven illumination and information display 



(57) An eyetracker is used to control power to an 
electrical device such as a computer display screen so 
that power consumption is reduced when a user's eyes 



and therefore a user's attention are not directed to the 
device. Amotion detector. activates a proximity, detector 
and/or an IR detector to ensure that power is applied 
only when a user is actually present. 
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for a predetermined time interval or when the user's 
eyes fix on a particular point on the screen. Alternatively, 
the intensity level can be reestablished when the user's 
eyes begin to move toward the display. Power to the 
eyetracker is removed when the user has not looked at s 
the display for a predetermined period of time. 

The invention also relates to a method for automat- 
ically applying power to an electrical device, by detect- 
ing motion, by detecting proximity of objects to the de- 
vice; and by applying power to the device when an ob- ?o 
ject is within a predetermined distance from the electri- 
cal device within a predetermined period of time after 
motion has been detected. 

The invention also relates to a method of controlling 
intensity of images on a display, by detecting where a is 
user's eyes are looking and by changing intensity of im- 
ages on the display based on where a user's eyes are 
looking. 

The invention is also directed to a computer system 
including a network, a plurality of computers connected 20 
to the network, one of which is a computer equipped with 
a motion detector a proximity detector activated by the 
motion detector detecting motion; and a switch connect- 
ed to a source of power and to the electrical device and 
controlled by the motion detector and the proximity de- 2s 
lector for applying power to the at least a particular one 
of the plurality of computers when the proximity detector 

- detects an object within a predetermined distance from 

- the computer. 

The invention is also directed to computer program 30 . 
products each including a memory.medium and contain- 
ing one or more computer programs and data used to 
implement the above methods, apparatus and systems. 

Still other objects and advantages of the present in- 
vention will become readily apparent to those skilled in 3S 
the art from the following detailed description, wherein 
only the preferred embodiment of the invention is shown 
and described, simply by way of illustration of the best 
mode contemplated of carrying out the invention. As will 
be realized, the invention is capable of other and differ- 40 
ent embodiments, and its several details are capable of 
modifications in various obvious respects, all without de- 
parting from the invention. Accordingly, the drawing and 
description are to be regarded as illustrative in nature, 
and not as restrictive. 45 

BRIEF DESCRIPTION OF DRAWINGS 

The objects, features and advantages of the system 
of the present invention will be apparent from the follow- so 
ing description in which: 

Figure 1 illustrates apparatus for automatically 
powering up and powering down an electrical device 
having an optional interface to a computer bus. 

Figure 2A is an illustration of a computer which is ss 
selectively battery operated and suitable for use with the 
invention. 

Figure 2B is an illustration of an exemplary compu- 



ter architecture incorporating the invention. 

Figure 2C is an illustration of an exemplary memory 
medium used to store computer programs and data of 
the invention. 

Figure 3 is a state transition diagram of a computer 
process used in accordance with the invention. 

Figure 4 is a state transition diagram of a power 
save process shown in Figure 3. 

Figure 5 is a flow chart of a power down process 
shown in Figure 3. 

Figure 6 is a flow chart of one power control proc- 
ess used as part of the invention. 

Figure 7 is a. flow chart of another power control 
process used in accordance with the invention. 

NOTATIONS AND NOMENCLATURE 

The detailed descriptions which follow may be pre- 
sented in terms of program procedures executed on a 
computer or network of computers. These procedural 
descriptions and representations are the means used 
by those skilled in the art to most effectively convey the 
substance of their work to others skilled in the art. 

A procedure is here, and generally, conceived to be 
a self-consistent sequence of steps leading to a desired 
result. These steps are those requiring physical manip- 
ulations of physical quantities. Usually, though not nec- 
essar if y, these quantities take the form of electrical or 
magnetic signals capable of being stored, transferred, 
combined, compared, and otherwise manipulated. It 
proves convenient at times, principally for reasons of 
common usage, to refer to these signals as bits, values, 
elements, symbols, characters, terms, numbers, or the 
like. It should be noted, however, that all of these and 
similar terms are to be associated with the appropriate 
physical quantities and are merely convenient labels ap- 
plied to these quantities. 

Further, the manipulations performed are often re- 
ferred to in terms, such as adding or comparing, which 
are commonly associated with mental operations per- 
formed by a human operator. No such capability of a 
human operator is necessary, or desirable in most cas- 
es, in any of the operations described herein which form 
part of the present invention; the operations are ma- 
chine operations. Useful machines for performing the 
operation of the present invention include general pur- 
pose digital computers or similar devices. 

The present invention also relates to apparatus for 
performing these operations. This apparatus may be 
specially constructed for the required purpose or it may 
comprise a general purpose computer as selectively ac- 
tivated or reconfigured by a computer program stored 
in the computer. The procedures presented herein are 
not inherently related to a particular computer or other 
apparatus. Various general purpose machines may be 
used with programs written in accordance with the 
teachings herein, or it may prove more convenient to 
construct more specialized apparatus to perform the re- 
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control processes used in accordance with the inven- 
tion. The process begins with a power save state 310 
which is described more in detail in Figure 4. From the 
power save state, the state can transition either to a 
power-up state 320 or return to itself. From power-up s 
state 320, the invention can transition to a power-down 
state shown more in detail in Figure 5 (330) or return to 
itself. 

Turning to Figure 4, if motion detector 110 shown 
in Figure 1 detects motion (410), the proximity detector io 
and the IR detector are activated (420). If they are both 
activated, then a check is made to determine if proximity 
of the object whose motion is detected is less than the 
threshold (430) and then a check made to see if the IR 
level is greater than a threshold (440). If it is, switch 1 45 is 
shown in Figure 1 is closed and power is applied to ter- 
minal 106 to power-up the external device thus entering 
the power-up state 320 shown in Figure 3. States 430 
and 440 can transition to "set timer - state 450 if their 
conditions are not met. After timer 450 times out, it will 20 
transition to state 460 where the proximity detector and 
the IR detectors will be deactivated. State 460 will tran- 
sition back to state 410 and the process begin again. 
State 460 may also be entered externally from the pow- 
er-down state 330 shown in Figure 3. 25 

Figure 5 shows more in detail the power-down state 
transition diagram 330 of Figure 3. When entered from 
the power-up state 320 of Figure 3, a set timer state 
520 is entered which corresponds to power-down timer 
150 shown in Figure 1. If motion is detected (state 530) 30 
timer 520 is reset. If no motion is detected, state 540 
results from a timeout -which triggers a power-down de- 
vice state 550. This corresponds to resetting of flip-flops 
140 and 115 if Figure 1. State 550 transitions back to 
power save state 300 shown in Figure 3 and more spe- 
cifically to state 460 within that state. 

Figure 6 is a flow chart of a one power control proc- 
ess used as part of the invention. Eyetracker290, shown 
in Figure 2B is utilized to control the illumination of im- 
ages on the display 220. How this is done is shown in 40 
Figure 6. The eyetracker outputs are processed to dis- 
tinguish four conditions shown in Figure 6, namely: 

1 . Whether the eyes are fixed at a point on the 
screen, 45 

2. Whether the eyes move off the screen, 

3. Whether the eyes are approaching the screen 
from a position off the screen, and 

4. Whether the eyes are moving across the screen. 
These four cases are distinguished by separate 
processing branches shown in Figure 6. When the 
eyetracker determines that the eyes are fixed on the 
screen, case 1 (610) obtains and the display inten- 
sity is set at normal illumination (615). 



pires without the eyes returning to the screen, the 
screen will slowly fade the display intensity to black 
(626). In the embodiment shown in Figure 6, once the 
eyes have been off the screen for a period of time great- 
er than the time set in item 625, cases 3 and 4 are treat- 
ed identically. That is, whether the eyes are approaching 
the screen or moving across the screen without fixing 
on the screen, the display intensity will resume normal 
illumination as quickly as possible. Normal illumination 
will thus continue until such time as the eyes leave the 
screen again. 

The embodiment shown in Figure 7, is identical for 
cases 1 and 2 as that shown in Figure 6. However, cas- 
es 3 and 4 are treated separately. In case 3, where the 
eyes are approaching the on-screen condition, in this 
embodiment, nothing happens. That is, the screen re- 
mains blank. However, case 4 results in measurement 
of the time that the eyes are on the screen. If the time 
the eyes are on the screen exceeds some threshold, the 
display intensity is resumed at normal illumination as 
quickly as possible. 

Thus, in accordance with the invention, electrical 
devices powered by energy sources of finite capacity 
can utilize the energy available to the maximum extent 
possible and reduce energy waste to a minimum. 

In this disclosure, there is shown and described only 
the preferred embodiment of the invention, but, as afore- 
mentioned, it is to be understood that the invention is 
capable of use in various other combinations and envi- 
ronments and is capable of changes or modifications 
within the scope of the inventive concept as expressed 
herein. 
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In case number 2 (620), when the eyes move from 
the screen to a point off the screen, a time interval of, 
preferably, 1/10 of a second (625) is set. If that time ex- 



Apparatus for automatically applying power to an 
electrical device, comprising; 

a. a motion detector; 

b. a proximity detector, activated by said motion 
detector detecting motion; 

c. a switch connected to a source of power and 
to said electrical device and controlled by said 
motion detector and said proximity detector for 
applying power to said electrical device when 
the proximity detector detects an object within 
a predetermined distance from the electrical 
device while activated by said motion detector. 

2. The apparatus of claim 1 , further including a power 
off timer, activated when power is applied to said 
electrical device and reset by said motion detector 
detecting motion for controlling said switch to re- 
move power from said electrical device when the 
timer times out. 

3. The apparatus of claim 1 , in which said electrical 



5 



11 



EP 0 810 512 A1 



c.2. a proximity detector, activated by said 
motion detector detecting motion; and 
c. 3. a switch connected to a source of pow- 
er and to said electrical device and control- 
led by said motion detector and said prox- s 
imity detector for applying power to said at 
least a particular one of said plurality of 
computers when the proximity detector de- 
tects an object within a predetermined dis- 
tance from the said at least a particular one 10 
of said plurality of computers while activat- 
ed by said motion detector. 

21. A computer program product for implementing in- 
tensity control of a computer display, comprising: is 

a. a computer readable memory medium; and 

b. a computer program including 

b.1 . instructions for detecting where a us- 20 
er's eyes are looking; and 
b.2. instructions for changing intensity of 
images on said display based on where a 
user's eyes are looking. 

25 

22. The computer program product of claim 21 in which 
the computer program further includes instructions 
for gradually reducing the intensity of images from 
a preexisting level to zero when a user's eyes are 
looking at a point off the display. 30 

23. The computer program product of claim 21 in which 
the computer program further includes instructions 
for restoring said preexisting level when a users 
eyes look at a point on said display. 35 

24. A computer program product for applying power to 
an electrical device, comprising: 

a. a computer readable memory medium; and 40 

b. a computer program including: 

b. 1 instructions for detecting motion; 
b.2 instructions for detecting proximity of 
objects to said device; and 45 
b.3 instructions for applying power to said 
device when an object is within a predeter- 
mined distance from the electrical device 
within a predetermined period of time after 
motion has been detected. so 
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